Stochastic Impulse Control of Non-Markovian Processes
نویسندگان
چکیده
We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of combined optimal stochastic and impulse control of a fairly general class of diffusions with random coefficients. Unlike, in the Markovian framework, we cannot apply quasi-variational inequalities techniques. We rather derive the main results using techniques involving reflected BSDEs and the Snell envelope. AMS subject Classifications: 60G40; 60H10; 62L15; 93E20; 49N25.
منابع مشابه
Almost sure exponential stability of stochastic reaction diffusion systems with Markovian jump
The stochastic reaction diffusion systems may suffer sudden shocks, in order to explain this phenomena, we use Markovian jumps to model stochastic reaction diffusion systems. In this paper, we are interested in almost sure exponential stability of stochastic reaction diffusion systems with Markovian jumps. Under some reasonable conditions, we show that the trivial solution of stocha...
متن کاملApplications of Borovkov's Renovation Theory to Non-stationary Stochastic Recursive Sequences and Their Control
We investigate in this paper the stability of non-stationary stochastic processes, arising typically in applications of control. The setting is known as stochastic recursive sequences, which allows us to construct on one probability space stochastic processes that correspond to diierent initial states and even diierent control policies. It does not require any Markovian assumptions. A natural c...
متن کاملBSDE Approach to Non-Zero-Sum Stochastic Differential Games of Control and Stopping
This paper studies two non-zero-sum stochastic differential games of control and stopping. One game has interaction in the players’ stopping rules, whereas the other does not. Solutions to backward stochastic differential equations (BSDEs) will be shown to provide the value processes of the first game. A multi-dimensional BSDE with reflecting barrier is studied in two cases for its solution: ex...
متن کاملSingular Stochastic Control and Optimal Stopping with Partial Information of Itô-Lévy Processes
Abstract. We study partial information, possibly non-Markovian, singular stochastic control of Itô–Lévy processes and obtain general maximum principles. The results are used to find connections between singular stochastic control, reflected backward stochastic differential equations, and optimal stopping in the partial information case. As an application we give an explicit solution to a class ...
متن کاملPhase-Type Approximations for Non-Markovian Systems
We introduce a novel stochastic process algebra, called PHASE, which directly supports phase-type distributions, useful for approximating the dynamics of non-Markovian HCI systems. In order to encourage the effective use of PHASE, we give a step by step account of how PHASE processes can be implemented in PRISM, one of the most powerful and popular probabilistic model checkers currently availab...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008